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Vaudity  of  the  Air  Traffic  Control  Specialist  (ATCS) 
Nonradar  Screen  as  a  Predictor  of  Performance  in  Radar- 
based  Air  Traffic  Control  Training 


The  FAA  air  traffic  control  specialist  (ATCS)  selec¬ 
tion  system,  from  October  1985  through  January 
1992,  consisted  of  two  stages.  The  first  stage  was  the 
written  Office  of  Personnel  Management  (OPM)  air 
traffic  control  selection  test  battery.  Less  than  10%  of 
over  200,000  applicants  that  completed  the  first  stage 
written  examination  were  chosen  to  progress  to  the 
second  stage,  the  42-day  Nonradar  Screen.  During  this 
period,  of  the  1 4,392  persons  that  entered  the  Nonradar 
Screen,  56.6%  were  successful  and  assigned  to  field 
facilities  for  up  to  5  years  of  developmental  training. 
Some  80%  of  these  trainee  controllers,  termed 
"developmentals,”  were  assigned  to  training  in  termi¬ 
nal  or  en  route  facilities  equipped  with  radar.  Terminal 
facilities  provide  air  traffic  control  (ATC)  services  at 
and  around  airports,  while  en  route  facilities  generally 
provide  ATC  services  between  airports.  In  view  of  the 
high  placement  rate  into  radar-equipped  facilities, 
concern  was  raised  about  the  validity  of  the  Nonradar 
Screen  as  a  predictor  of  performance  in  the  radar-based 
environment  of  today’s  air  traffic  control  system  (Aero¬ 
space  Sciences,  Inc.,  1991). 

Della  Rocco,  Manning,  and  Wing  (1990)  had  also 
questioned  the  validity  of  the  Nonradar  Screen  as  a 
predictor  of  success  in  radar-based  air  traffic  control. 
They  compared  the  content  of  the  Nonradar  Screen  to 
tasks  performed  by  an  en  route  radar  controller  and 
concluded  that  many  of  the  behaviors  assessed  in  the 
Nonradar  Screen  were  similar  to  those  required  in  the 
radar  environment  (p.  19).  No  statistical  analyses  of 
the  relationship  of  Nonradar  Screen  score  to  radar- 
oriented  criteria  were  presented  to  buttress  the  argu¬ 
ment  for  content  validity.  However,  Della  Rocco,  et  al. 
(1990)  did  show  that  the  Screen  predicted  status  in 
field  training  for  persons  assigned  to  en  route  air  traffic 
facilities  (r  «  -.24,  N*  406,  p  s,  .01).  Field  training 
status  in  that  study  was  coded:  1  -  Full  Performance 
Levek  In  Training  in  Original  Option-,  3  -  Switched 
Options-,  and  4  -  Failed.  The  estimated  population 
validity  coeffiicient  for  the  Screen  after  correcting  for 
restriction  in  range  was  -.44. 


The  purpose  of  this  research  was  to  build  on  that 
previous  study  by  empirically  assessing  the  crite¬ 
rion-related  validity  of  the  Nonradar  Screen  for  the 
prediction  of  performance  in  radar-based  ATC  train¬ 
ing..  Radar  training  was  used  in  this  study  as  a 
surrogate  criterion  for  actual  radar  ATC  job  perfor¬ 
mance  because  adequate  on-the-job  measures  were 
not  available.  We  hypothesized  that  the  final  com¬ 
posite  score  in  the  Nonradar  Screen  would  show 
significant  incremental  validity  over  the  OPM  ap¬ 
titude  test  score  in  the  prediction  of  radar-based 
ATC  training  performance. 

Method 

Sample 

The  sample  used  in  this  study  was  comprised  of 
1,639  first-time  competitive  entrants  to  the  Screen 
who  had  also  attended  the  en  route  or  terminal  radar 
training  programs.  The  sample  entered  the  Nonradar 
Screen  during  the  years  1987  to  1990,  and  attended 
the  radar  course  at  some  time  between  1988  and  1991. 
Table  1  presents  overall  sample  demographic  charac¬ 
teristics,  as  compared  with  the  population  of  all  com¬ 
parable  first-time,  competitive  Nonradar  Screen 
entrants  entering  the  system  since  October  1985.  Fewer 
minorities  and  women  were  represented  in  this 
sample  than  were  in  the  population  of  Nonradar 
Screen  entrants.  Controllers  assigned  to  terminal 
facilities  were  also  over-represented  in  comparison 
to  historical  placements  due  to  differences  in  pro¬ 
gram  enrollment  policies. 

Measures 

Aptitude  score.  The  written  aptitude  test  was  ad¬ 
ministered  by  the  U.S.  Office  of  Personnel  Manage¬ 
ment  (OPM)  as  the  first  stage  in  the  ATCS  selection 
system.  The  general  development,  psychometric  char¬ 
acteristics,  and  validity  of  this  test  battery  have  been 
extensively  described  (Della  Rocco,  Manning,  &  Wing, 
1990;  Manning,  Della  Rocco,  &  Bryant,  1989;  Rock, 
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Table  1 

Sample  demographic  characteristics 


Characteristic 

Category 

Population 
(N=  14,392) 

Sample 
{N=  1,639) 

Age 

Mean 

26.00 

25.42 

SD 

2.99 

2.76 

Sex 

Male 

79.6%  (11,460) 

86.6% 

(1,420) 

Female 

20.4%  (  2,932) 

13.4% 

(  219) 

Race 

Native  American 

0.6%  (  91) 

0.5% 

(  8) 

Asian 

1.4%  (  195) 

0.4% 

(  7) 

African  American 

5.7%  (  819) 

3.2% 

(  52) 

Hispanic  Non-white 

3.6%  (  525) 

1.9% 

(  31) 

White  Non-hispanic 

85.9%  (12,366) 

91.3% 

(1,496) 

Unknown 

2.8%  (  396) 

21% 

(  44) 

Assigned  Option 

En  Route 

33.3%  (4.786) 

39.7% 

(  651) 

Terminal 

23.3%  ( 3,354) 

60.3% 

(  988) 

Not  Applicable^ 

43.4%  ( 6,252) 

NOTES:  ^Assigned  option  not  applicable  for  persons  wbo  &iled  or  withdrew  from  tiie  Nonradar  Screen 


Dailey,  Ozur,  Boone,  &  Pickrel,  1 982;  Sells,  Dailey,  Sc 
Pickrel,  1984).  The  written  civil  service  ATCS  apti¬ 
tude  battery  was  composed  ofi  (a)  the  Multiplex  Con¬ 
troller  Aptitude  Test}  (b)  a  test  of  Abstract  Reasoning 
and  (c)  an  Occupational  Knowledge  Test,  Results  from 
the  test  battery  were  combined  with  any  veteran’s 
preference  points  to  yield  a  final  civil  service  rating 
(RATING)  for  competitive  entrants.  This  rating  was 
used  to  rank-order  competitive  ATCS  job  applicants 
within  sututory  guidelines,  such  that  hiring  was  done 
on  the  basis  of  merit  (Aul,  1991).  A  candidate  with  a 
qualifying  aptitude  score  was  also  required  to  undergo 
medical  and  security  evaluations  and  complete  an 
interview  before  being  hired.  The  successful  applicant 
was  then  hired  by  the  FAAand  enrolled  in  theNonradar 
Screen.  This  overall  civil  service  RATING  was  used  as 
the  measure  of  aptitude  for  the  ATCS  occupation  in 
this  study.  Mean  aptitude  scores  for  the  sample  of 
Nonradar  Screen  students  who  attended  radar  training 
are  compared  with  the  population  of  Nonradar  Screen 


entrants  for  which  scores  were  available  in  Table  2. 
Mean  RATING  differences  between  the  samples  and 
population  were  not  statistically  significant. 

ATCS  Screen  score.  Persons  competitively  hired 
into  the  ATCS  occupation  (GS-2152;  U.S.  Depart¬ 
ment  of  Labor  ( 1 977)  Dictionary  of  Occupational  Titles 
job  code  193.162-018)  by  these  civil  service  proce¬ 
dures  reported  to  the  FAA  Academy  and  were  enrolled 
in  the  Nonradar  Screen.  The  Nonradar  Screen  was 
originally  established  in  response  to  recommendations 
made  by  the  U.S.  Congressional  House  Committee  on 
Government  Operations  (U.S.  Congress,  1976)  to 
reduce  field  training  attrition  rates.  The  Nonradar 
Screen  was  based  upon  a  miniaturized  training-test- 
ing-evaluation  personnel  selection  model  (Siegel,  1978, 
1983;  Siegel  &  Bergman,  1975)  in  which  individuals 
with  no  prior  knowledge  of  the  occupation  were  trained 
and  then  assessed  for  their  potential  to  succeed  in  a  job. 
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Overall,  56.6%  of  all  entrants  successfully  completed 
the  Nonradar  Screen  over  the  period  of  January  1986 
to  March  1992. 

Thirteen  assessments  of  performance,  including 
classroom  tests,  observations  of  performance  in  labo¬ 
ratory  simulations  of  non-radar  air  traffic  control,  and 
a  final  written  examination,  were  made  during  the 
Nonradar  Screen  (Della  Rocco,  Manning,  &  Wing, 
1990).  The  final  summed  composite  score  (SCREEN) 
was  weighted  20%  for  academics,  60%  for  laboratory 
simulations,  and  20%  for  the  final  examination.  A 
minimum  SCREEN  score  of  70  was  required  to  pass 
the  Nonradar  Screen.  This  final  composite  score  was 
the  predictor  of  interest  in  this  study.  SCREEN  scores 
for  this  sample  are  compared  in  Table  2  with  the 
population  of  first-time  competitive  Nonradar  Screen 
entrants.  Mean  SCREEN  scores  for  the  terminal  and 
en  route  samples  were  higher  than  those  of  the  popu¬ 
lation,  due  to  explicit  selection  of  the  sample  on 
SCREEN. 

Radar  score.  Those  persons  who  successfully  com¬ 
pleted  the  Nonradar  Screen  entered  into  long-term 
occupational  technical  training  as  developmentals  in 
either  en  route  or  terminal  facilities.  Both  en  route  and 
terminal  controllers  ensure  the  separation  of  aircraft 
by  using  information  about  the  speed,  direction,  and 
altitude  of  aircraft  to  (a)  formulate  clearances  and  (b) 
communicate  those  clearances  to  pilots.  Clearances  are 
sets  of  instructions  designed  to  ensure  the  safe,  orderly, 
and  expeditious  flow  of  air  traffic. 

After  succe.ssfully  completing  the  Screen,  ATCSs 
generally  reported  to  their  specific  facility  assignments, 
and  received  training  on  the  ATC  procedures  specific 
to  their  assigned  airspace.  During  the  period  examined 
in  this  study,  most  controllers  assigned  to  facilities 
utilixing  radar  procedures  returned  to  the  FAA  Acad¬ 
emy  for  initial  radar  training  at  the  FAA  Academy 
Radar  T raining  Facility  (RTF) .  Radar  training  courses 
were  conducted  separately  for  each  type  of  facility 
using  the  high-fidelity  simulation  capabilities  of  the 
Academy  RTF. 

The  Academy  RTF  terminal  ("Terminal  RTF”)  and 
en  route  (“En  Route  RTF”)  courses  instructed  the 
developmental  controller  in  basic  radar  techniques  in 
the  safety  of  a  simulated  airspace  before  the  controller 


applied  those  skills  in  a  live  traffic  environment  during 
subsequent  phases  of  on-the-job  training.  Instruction 
covered  topics  such  as,  principles  of  radar,  radar  iden¬ 
tification  procedures,  radar  separation  procedures, 
vectoring,  speed  control,  and  radar  handoffs  (Boone, 
van  Buskirk,  &  Steen,  1980;  Federal  Aviation  Admin¬ 
istration,  1991).  Topics  specific  to  a  facility  type  were 
also  covered  in  the  respective  courses,  such  as  depar¬ 
ture  and  arrival  procedures  in  Terminal  RTF.  Didactic 
classroom  instruction  was  provided  to  students,  and 
written,  multiple-choice  examinations  were  adminis¬ 
tered  at  the  end  of  academic  instruction.  Since  1 986, 
those  written  examinations  comprised  30%  of  the  final 
radar  composite  score  in  each  option.  Students  then 
applied  that  knowledge  in  a  series  of  increasingly 
complex  radar  control  problems.  The  last  five  control 
problems  were  graded,  and  comprised  70%  of  the  total 
composite  grade  in  each  radar  course.  Mean  final 
radar  composite  scores  (ENRT_RAD  for  en  route, 
TERM_RAD  for  terminal)  for  this  sample  are  com¬ 
pared  with  their  respective  population  means  in 
Table  2. 

Procedure 

Multiple  regression  was  used  to  test  the  hypothesis 
that  performance  in  the  Nonadar  Screen  (SCREEN) 
added  incremental  validity  over  aptitude  (RATING) 
in  the  prediction  of  performance  in  radar  training 
(ENRT_RAD  or  TERM_RAD) .  Separate  analyses  were 
conducted  for  the  en  route  and  terminal  courses  in 
light  of  apparent  differences  between  control  tech¬ 
niques,  procedures,  and  rules  in  the  two  ATC  environ¬ 
ments.  The  analyses  were  conducted  using  both  raw 
data  and  a  correlation  matrix  corrected  for  explicit  and 
incidental  restriction  in  range  due  to  selection  on 
SCREEN  as  required  by  the  Uniform  Guidelines  on 
Employee  Selection  Procedures  (Equal  Employment 
Opportunity  Commission,  1978).  Specifically,  corre¬ 
lations  between  RATING  and  SCREEN  (breach  group 
were  corrected  for  range  restriction  due  to  prior  selec¬ 
tion  on  SCREEN.  Correlations  between  RATING 
and  radar  composite  scores  for  each  group  were  cor¬ 
rected  for  incidental  restriction  in  range  due  to  the 
selection  of  the  sample  on  SCREEN.  Finally,  the 
correlations  between  SCREEN  and  ENRT_RAD  and 
TERM_RAD  were  corrected  for  explicit  restriction  in 
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range  due  to  selection  on  SCREEN,  using  formulae 
presented  by  Ghiselli,  Campbell,  and  Zedeck  (1981, 
p.  299).  Corrected  matrices  for  en  route  and  terminal 
trainees  were  submitted  separately  for  regression  analy¬ 
sis.  In  the  regression  analyses,  RATING  was  first 
entered  into  the  prediction  equation  to  assess  the 
amount  of  variance  in  radar  composite  scores  ac¬ 
counted  for  by  aptitude.  SCREEN  was  then  regressed 
on  radar  performance  by  using  a  stepwise  entry  to 
assess  the  incremental  validity  of  SCREEN  for  each 
ATC  environment. 

Results 

En  Route 

The  zero-order  correlations  between  RATING, 
SCREEN,  and  ENRT_RAD  are  presented  in  Table  3. 
These  correlations  are  likely  to  be  underestimated, 
because  of  the  high  degree  of  restriction  in  range  due 
to  explicit,  successive  selections  on  both  RATING  and 
SCREEN.  Performance  in  the  Nonradar  Screen  was 
significantly  correlated  with  performance  in  en  route 
radar  training  (r  »  .28,  N*  533,  .001).  Correcting 

for  explicit  restriction  in  range  increased  the  RATING 
-  SCREEN  and  SCREEN  -  ENRT.RAD  correlations 
to  .37  and  .50  respectively  (as  shown  in  parentheses)  in 
Table  3.  The  correlation  between  RATING  and 
SCREEN  increased  from  .20  {Nm  549,^^.001)  to  .22 
after  correction  for  incidental  restriction  in  range. 
This  was  consistent  with  other  studies  examining  the 


validity  of  the  written  aptitude  examination  (Man¬ 
ning,  Della  Rocco,  &  Bryant,  1989;  Manning,  Kegg, 
&  Collins,  1989). 

The  results  of  the  en  route  regression  analysis  are 
presented  in  Table  4.  RATING  was  forced  into  the 
equation  in  the  first  step  (/?=  .17,  /(1, 439)  =  13.19,^ 
S.  .001),  and  accounted  for  about  3%  of  variance  in 
ENRT_RAD.  SCREEN  was  then  regressed  on 
ENRT_RAD  in  the  second  block,  using  a  stepwise 
procedure  to  control  variable  entry.  SCREEN  ac¬ 
counted  for  an  additional  8%  of  variance  in 
ENRT_RAD  (A/P  *  .08,  F*  36.52, .001)  without 
correction  for  restriction  in  range.  After  correcting  the 
SCREEN  -  ENRT_RAD  correlation  for  restriction  in 
range,  SCREEN  accounted  for  an  additional  20%  of 
variance  in  radar  training  performance  (A/P  =  .20,  F= 
146.84,  p  i  .001).  The  corrected  partial  correlation 
between  SCREEN  and  radar  performance;  for  en  route 
developmental  was  .48  (<(1,438)  =  12.12, /»<  .001). 

Terminal 

The  zero-order  correlations  between  RATING, 
SCREEN,  and  TERM_RAD  are  presented  in  Table  5. 
The  uncorrected  correlation  of  .26  {N-  S27,p£.  .001) 
between  RATING  and  SCREEN  was  consistent  with 
other  studies  examining  the  validity  of  the  written 
aptitude  examination  (Manning,  Kegg,  &  Collins, 
1989),  as  was  the  correlation  of  .19  {N=  661)  between 
RATING  and  TERM_RAD.  These  correlations  were 
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En  Route  descriptive  statistics,  zero-order  correlations,  and  correlations  corrected  for  range  restriction 


RATING 

92.37 

4.47 

549 

SCREEN 

79.88 

5.91 

651 

.20* •• 

(.37) 

ENRT_RAD 

84.14 

5.27 

533 

.17*** 

.28*** 

(.22) 

(.50) 

Measure 

Mean 

SD 

N 

RATING 

SCREEN 

NOTES:  Correlations  corrected  for  range  restrictions  shown  in  parentheses.  ***  p  s.OOl 
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Tables 


Terminal  xeroHirder  raw  and  correlations  corrected  for  range  restriction 


RATING 

92.34 

4.65 

827 

SCREEN 

77.78 

6.78 

988 

.26* •• 
(.41) 

TERM_RAD 

80.32 

6.44 

988 

.19*** 

(.32) 

.31*** 

(.50) 

Measure 

Mean 

SD 

N 

RATING 

SCREEN 

NOTES:  Correlations  corrected  for  range  restrictions  shown  in  parentheses  ***  ps  .001 


likely  to  be  underestimated,  because  of  the  high  degree 
of  restriction  in  range  due  to  explicit,  successive  selec¬ 
tions  on  both  RATING  and  SCREEN.  SCREEN  was 
significantly  correlated  with  performance  in  terminal 
radar  training  (r-  .31,  N*  805,  ^:S.  <001).  Correcting 
for  explicit  restriaion  in  range  due  to  selection  on 
SCREEN  increased  the  RATING  -  SCREEN  and 
SCREEN  -  TERM_RAD  correlations  to  .41  and  .50 
respectively  (as  shown  in  parentheses)  in  Table  5.  The 
RATING  -  TERM_RAD  correlation  increased  to  .32 
after  correction  for  incidental  restriction  range  due  to 
selection  of  the  sample  on  SCREEN. 

The  results  of  the  terminal  regression  analysis  are 
presented  in  Table  6.  RATING  was  forced  into  the 
equation  in  the  first  step  (R*  .19,  f(l,659)  >  23.66, p 
^  .001),  and  accounted  for  about  3%  of  variance  in 
TERM_RAD.  SCREEN  was  then  regressed  on 
TERM_RAD  in  the  second  block,  using  a  stepwise 
procedure  to  control  variable  entry.  SCREEN  scores 
accounted  for  an  additional  10%  of  variance  in  termi¬ 
nal  radar  training  performance  {AJP  ■  .10,  77.66, 

/ i  .00 1 ).  After  correcting  the  SCREEN  -  TERM_RAD 
correlation,  SCREEN  scores  accounted  for  an  addi¬ 
tional  16%  of  variance  in  TERM_RAD  (A/F  =  .16,  f 
-  178.58,  .001).  The  corrected  partial  correlation 

between  SCREEN  and  radar  performance  for 
developmental  assigned  to  terminal  facilities  was  .44 
(<(1.659)  »  13.63, 001). 


Discussion 

The  results  suggest  that,  for  developmentals  as¬ 
signed  to  en  route  facilities,  the  Nonradar  Screen  score 
added  significantly  to  the  prediction  of  radar  training 
performance,  over  and  above  the  contribution  of  the 
aptitude  score.  The  percentage  of  variance  accounted 
for  by  both  predictors  in  this  study  ( 1 0%  uncorrected) 
is  consistent  with  that  found  by  Manning  (8%  uncor¬ 
rected;  1991)  when  predicting  status  in  facility-spe¬ 
cific  en  route  field  training.  However,  in  Manning’s 
(1991)  study,  the  aptitude  score  contributed  about  as 
much  to  the  prediction  of  field  training  performance  as 
did  the  Nonradar  Screen  score  after  correcting  for 
range  restriction.  Manning  reported  a  partial  correla¬ 
tion  between  aptitude  and  en  route  field  status  of  .29 
and  a  partial  correlation  of  .39  between  Nonradar 
Screen  score  and  field  status.  In  this  study,  the  Nonradar 
Screen  score  had  the  higher  partial  correlation  with 
performance  in  radar  training.  The  results  obtained  in 
the  present  study  also  suggested  that  the  Nonradar 
Screen  was  a  reasonably  valid  predictor  of  terminal 
radar  training  performance.  Moreover,  the  correlation 
between  Nonradar  Screen  and  terminal  radar  training 
performance  (.3 1  uncorrected)  in  this  study  was  con¬ 
sistent  with  the  correlation  between  the  Nonradar 
Screen  score  and  instructor’s  assessment  of  develop¬ 
mental  performance  in  the  facility  radar  qualification 
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Table  6 


phase  of  field  training  (.30,  uncorrected)  reported  by 
Manning,  Della  Rocco,  and  Bryant  (1989).  We  con¬ 
cluded  that  performance  on  nonradar  air  traffic  con¬ 
trol  tasks  was  a  v«lid  indicator  of  potential  to  perform 
radar-based  air  traffic  control  tasks. 

However,  there  may  be  alternative  explanations  for 
the  significant  relationship  between  the  Nonradar 
Screen  score  and  radar  training  performance.  First, 
procedures  for  grading  of  classroom  examinations  and 
laboratory  simulation  problems  in  the  Nonradar  Screen 
and  the  £n  Route  and  Terminal  Radar  courses  were 
very  similar.  Both  courses  contained  written  tests  com¬ 
prised  of  multiple  choice  items.  In  the  laboratory 
problems  administered  during  each  course,  instructors 
observed  student  performance  over  a  30-minute  time 
period,  recorded  specific  technical  errors  made  by  the 
student,  and  provided  feedback  after  the  problem  was 
completed.  Errors  included  the  fiiilure  to  maintain 
sufficient  separation  between  aircraft,  failure  to  use 
appropriate  procedures,  failure  to  coordinate  appro¬ 
priately  with  other  controllers,  and  failure  to  use  proper 
phraseology  in  the  Nonradar  Screen  and  both  radar 
training  courses.  Scores  on  the  laboratory  problems  in 
all  courses  were  based  upon  a  weighted  composite  of 
the  errors  committed,  where  the  more  serious  errors 
(e.g.,  separation)  received  higher  weights  than  did  the 
less  serious  errors.  Similarity  in  the  content  of  the 
materials  and  the  grading  of  the  laboratory  problems 
may  have  resulted  in  shared  method  variance  that 
might  account  for  a  portion  of  the  correlation  in 
performance  between  the  nonradar  and  radar  courses. 

On  the  other  hand,  many  of  the  activities  involved 
in  controlling  air  traffic  using  en  route  radar,  terminal 
radar,  or  en  route  nonradar  procedures  are  similar. 
Both  en  route  and  terminal  radar  controllers  perform 
the  primary  activities  of  monitoring  aircraft  positions, 
resolving  aircraft  conflicts,  managing  air  traffic  se¬ 
quences,  planning  flights,  assessing  the  impact  of 
weather,  and  managing  position  resources  (Alexander, 
Ammerman,  Fairhurst,  Hostetler,  &  Jones,  1989, 
1990).  However,  within  each  global  activity, 
subactivities  differ  for  en  route  and  terminal  radar 
controllers.  In  spite  of  some  equipment  and  proce¬ 
dural  differences  between  the  two  options,  perfor¬ 


mance  in  each  option’s  training  program  was  predicted 
about  equally  well  by  the  combination  of  nonradar  and 
aptitude  scores. 

The  results  of  this  study  provide  evidence  of  the 
validity  of  the  Nonradar  Screen  in  predicting  radar 
training  performance  (over  and  above  the  prediction 
of  the  first-stage  OPM  selection  battery).  This  pro¬ 
vides  empirical  support  for  the  logical  arguments  for  a 
relationship  between  nonradar  and  radar  ATC  activi¬ 
ties.  These  results  also  indicate  that  nonradar  simula¬ 
tions  cannot  be  dismissed  as  predictors  of  radar-based 
ATC  on  the  basis  of  “face  validity.”  Rather,  additional 
research  is  required  to  elucidate  the  cognitive  con¬ 
structs  underlying  this  empirical  relationship  between 
nonradar  and  radar  air  traffic  control  performance  as  a 
part  of  the  development  of  new  ATCS  selection  tests. 
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